Detennine a stqjping angle 



so 



I 



Loop to move the rotating turntable to different 
positions based on the stepping angle 



?2 



Output positioning signal(s) 
to the rotating ttamtable 



i Output signals to the camera 
to collect an image 



[ 



Store the image data 



X 



Store information to link the angle of 
rotation of the rotating turntable 
with the captured image. 



40 




Loop 



Fig . 2 
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3D model builder application 



Silhouette Processing Module 



105 

110 
IIH- 



SDCanstruction Module 



Silhouette Images 



Silhouette Mask Images 



Silhouette Contours 



Silhouette Contour Polygons I 








^ 11^ 


Triangulation Module ^ 


Triangulated Mesh 
Model 




1 


Texture Map Module 


1 


Texture Images 


1 



J 



Fig. 10 



Silhouette Processing Module 

I 



15+ 
162 

r 



Background Mask Procedure 
I 



Initial Silhouette Mask Procedure 



Coefficient Determination Procedure 

I — 



Background Subtraction Module 

I 



ClusterizationSmall Cluster Removal Module 



Clusterization 



Remove Small 
Clusters 



T 



I6i 



Polygon Shape Module 



Fig. 11 



clusterization/small cluster removal module j- 



.i _ _ 



f for each silhouette mask image 5 ^ 



read the next silhouette mask image 
(load it into bitmap array) 
(identify offeet) 

I 



r S 

J data array | 



allocate array to hold point hsts for 
silhouette contours 



silhouette point Ust array \ 



while there are more silhouette contours to find 
e.g. while more_silhouettes = true 

r 



call the clusterization module 

g. returns list of silhouette contours 



I 



end loop e:g. 
more_silhouette=false 




clusterization sub-module 1 



for each new silhouette contour on hst \ -\^ 3^3^ 



flip bits widiin 
contour region and count the bits 






small cluster removal 
sub-module 

z ~ 



add new silhouette c<Hitour « 
to silhouette point list array -V^ ^^3)V 



16+ 



reset silhouette contour point ordering variable ^ ^ % ^ 



store silhouette 




Fig. 19a 



^ Clusterization Sub-Module (starting point, ordering direction) ^ ^ 



allocate data structure to 
hold silhouette contour lists found in this 
pass of the bitmap array 

initialize it to empty 
(e.g. new silhouette list) 

I 



allocate bitmap to perform search 
operation at the current level of searching 



silhouette hst] 



bitmap array[] | 



do while more bits to check in bitmap array[] ^ 



get color assignment of bit to check 
(get search direction) 




call procedure to determine silhouette contour 
^^^^ List = traceSil houette( current point) 





reorder point hst (if needed) and 
add list to data structure 
(e.g. new silhouette list) 


-5 fSi 










Alter bitmap to mark as 'l)ackground" 
all bits within the boundary of the silhouette contour 




A/ 



return new silhouette list 



Fig. 19b 
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Trace Silhouette Procedure (first point, direction) L 



1% 



allocate data object to hold 
point list for silhouette contour 

intialize current point variable 
(e.g. current point = first point) 

allocate next point variable 



point list 



T 



loop to trace silhouette contour 
e.g. while (next point != first point) 



call get next point fiinction to find next point 9^ | (j 



check if loop self-intersects 
if so do additional processing 

I 



put bitmap location of next point 
onto Hst of points in 
silhouette data object 



prepare for next iteration of loop 
e.g. current point = next point 




return data object to hold point list 
for silhouette contour 



3D Constmction Module 



Calibration Module 



Initial 3D Object Building Module 



3D Refining Module 




Initial (rough) 
3D Model 



60<o 




q ^ 



'bis 

I List of Vertices 



List of Polygons ^y-^ ( 0 



Fig. 23 



£ 



— Initial 3D object building module 






Determine the n 
for the object a 


laximum length 
ong the Z axis 



s 



604 



Max LengthT] 



Select a silhouette contour polygon 
as the first polygon to process 



Ay 



Create a set of beginning and ending points 
(and far and near) polygons 



644 



Order the vertices of each face following 
an, e.g. counterclockwise ordering 
and build face object 

I 



Interconnect the far and near faces 
with additional faces 
(this creates a soUd 3D object) 



Fig. 24 



r 



3D Refining Module 

1 



Loop to process each of the remaining silhouette contour polygons 
that are in each of the remaining silhouette images 

T 



obtain a reference to the next silhouette image 
and its angle of rotation 

I 



project the vertices of the (rough) 3D model 606 
onto the plane of the silhouette image 
(the plane of the CCD chip) 
and store all of those 2D coordinates in an array 



obtain list of all of the silhouette contour polygons 
associated with that image 



Loop to process each of the faces of the current (rough) 3D model 606 



T 



obtain one of the faces of the 
current (rough) 3D model 



Prepare KD tree to analyze the projection of this face onto the 
plane which contains all of the silhouette contour polygons that 
are associated with this image 



Process the points of the current face 



Procedure to Path Holes in Model 
Knifing Procedure 




loop 



Fig. 29a 




Fig. 29b 



. X 



Locate a starting point on the projected face 
(A point that is "OUTSIDE" of the silhouette contours) 
(IF There are no "OUTSIDE" points then terminate processing) 

— 1 



mark point on the face as 'Visited" 
I 



Loop to tour the current vertices of the face 
' do until aU of the face vertices have been 'Sdsited" 



Visited List ] 

T 



^ -^"^ I get next point along the face ^ 3^ 



if next point is "IlslSlDjbi ^'^^ 
-'nd not already 'Sdsited" 



Create a new revised 
face list and tour the points 
See Fig. 29 A 



Mark point as being visited 



\ add new face to (rough) 3D modeF^ "?'^* 



locate next "OUTSIDE" point of face 
that has not yet been 'Visited" 
(If no more such points exist then 
terminate processing) 




loop 



753 it 



I 



Ess,! 



Fig. 29c 



Locate the point of intersection along edge "TS^ Oi 

^1 



determine 3D coordinate for the new point 
add it to the list of vertices^of the (rough) 3D model 



Add reference to new point onto 
the revised vertex list for the new face 



A-/ 



Set the Touring direction to 'TACE" 



e <^ Set the Toiiriny Start Point to the rurrent Point 



get next point following the Touring Direction 



I 



loop to process the points until the next pont = starting pomt 

' — c 



if the tour direction is 'Tace'' 
then tour the face 

SffiFjg ?r9fr 



if the tour direction is Silhouette Contour 
then tour the silhouette contour 
See Fig. 29f 



Fig. 29d 



(when tHe" system is tounng the T 
vertices and edges of the 'TACE") f 



Tfcurrent edge (edge that ends with next point) 
contains a new point of intersection 



locate the point of 
intersection along the edge 



determme a 3D coordinate 
for the new point (if it is a 
newly computed point then 
add it to the list of vertices) 



Add a reference to the new point 
onto the revised vertex list for the 
new face 



I 



Add a reference to the new 
point onto the revised vertex 
list for the new face 



Add a reference to the^new-- 
point onto the knifing Ust 
associated with the current 
edge of the silhouette 
contour polygon being 
intersected 



■737; 



Set the Touring Direction to 
be the Silhouette Contour 
that was just intersected 



Get Next Point By Face 
(Following Face Vertex List) 



I 



Get Next Point by Silhouette 
Contour (Following vertex 
list of Silhouette Contour) 




J (return to loop in step 7 J5h)\ 



I 

Fig. 29e 



(-7 35?J 



'1 




(when the system is tourmg the 
vertices and edges of a "SILHOUETTE CONTOUR POLYGON": 




determine a 3D coordinate for the 
new point (if it is a newly computed 
point then add it to the list of 
vertices) 



Add a reference to the new point 
onto the revised vertex list for the 
new face 



determine a 3D coordinate 
for the new point (if it is a 
newly computed point then 
add it to the list of vertices) 



I 

I 
I 



Add a reference to the new 
point onto the revised vertex 
list for the new face 



Add a reference to the new point 
onto the knifing list associated with 
■ the a^eritirdge of the silhouette 
"contour polygon being traced 



Add a reference to the new 
point onto the knifing list 
associated with the current 
edge of the silhouette 
contour polygon being traced 



Set the Touring Direction to 
be the FACE 



Get Next Point By Silhouette 
Contour Polygon 

(Following vertex List for Polygon) 



Get Next Point by FACE 
(Following vertex list of the 
FACE) 




X 



(return to loop in step 73 5h) 



Fig. 29f 




Fig. 30b 



Loop to process all of the knifing lists '7'^'7<^ 



j get a knifing list ^ ']^'^[, 



sort the point pairs on the knifing list by 
the Z-value of the first point 



loop to visit each of the point pairs on the list 
do while there are more unvisited point pairs 



get a point pair that has not yet been visited 



determine if the second point of the 
current point pair overlaps with the 
first point of another point pair 




J mark the overlapping point pair as visited l'45li 

r 



combine the point-pair that overlaps 
with the current point-pair to make 
a larger point-set 



loop until no second/first point overlap exists 
-and if current first point does not equal the current last point 



ioop>vl4^i^ 



create new faces fi-om the organized list "^4'? 



Fig. 31 
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1 — f 
e2 [ 
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e7 I 


H:70,30,92 | 


e3 1 


C: 10,50,30 
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e8 } 


1:70,60,90 j 


e4! 


D: 15,42,32 




e9 { 
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e5 1 


E:20,20,43 






K:50,85,70 1 




F:25,1050 
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W47s 



747r 
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7471 



Edge 10 
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747n 
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X 



1 



Edge 11 



N:90,26,115 



0:95,40,120 



Fie,. 3G 



Add additional edges to 
break each polygonal face that 
is not a triangle into a triangle 



Appiy other processing 
I (e g. adaptive subdivision of triangles) 



1 




— ~ — • -£[Step950~^ — _ 



Loop to process the current face 
(Stop processing when the face only 
Has 3 vertices) 




X 

•p to process each &ce of the 3D model 



Outface 4 ^ 



Get starting point ^ ^^^4 



^ Get the second and third points | ^ 



Attempt to draw an edge between l ^7 ^ 
The starting point and the third point ^il^ 



the starting point 
the values of the 
Second point 




I 



creates a new object for 
This three point face 




adjust object relationships 



f Loop to process each face ^^j ^ \ \0^ 
Get a reference to the next face . ^ 1 ] 



/ 



set a "largest map image" pointer to null 
t 



j set a "largest pixel area'' variabJe to 0 \^ 
£ loop to pr ocess each texture map image ^^^^ I^Oq 



^et a reference to a next image ('"the current image") 1 1 I ^ 

project a view of the current face on to a 
2D projection the same plane as the texture map view 
determine the orientation of the face vis a vis 





compute the area (e g. in pixels)/ * 
of the space of the face on the U ' ^ 
texture map plane. ( 

in 2 



If the area calculated intlie prevf 
' is greater than the ^'largest ai 



I larg 



largest area = area computed aDove 



^apimage = current tfte imagS 'j ^ 




/pad face^datTobject witffi^ference to the "largest image'^ ^ 
load the face data object with x,y coordinate locations for flZ / 



the texture map. 




r 



loop 




select a texture map image 
(an additiona l tex ture map) 



J 



l^project a view of the fixture map oti the screST")^ 



project an image of the 3D object also on the screen 
where the 3D object ir rotated to provide a view form 

the same view point as the camera when it took 
that textup map image 



vv4 



Set up for user events 
build coefficient list/matrix 




on mouse click locate' the fece from the modei 
that corresponds to the user input on a list 



1 on doneButton 



Loop to proceeds each face onjthe 
list 

■ J ' 



Place a reference to the 
additional texture map in the object's 
face 



.0 



^1^ 



[Calculate the x, y coordmates for the 1^ 
jkexture map area that will be mapped 
Jto the 3D coordinates of the face. 




Place a referencetoti 
coordinate for the texture map for 
^^ack mint in the face 




^ ^ 3D Model Builder Application — 



Silhouette Processing Module 




3D construction module 




ri^aiiorationj 



. Triangulation module 

— T 



\ silhouette images ^ 



r silhouette mask QQ ^ 
^ image objects 0 9 ' 



t r*"""^ 

I boo 



Spatial 
exture images 




background mask procedure 




initial silhouette processing module 



5* 



coefficient determination module 



background subtraction module 



. 



small cluster removal module 1 6 ^ ^ 

^ — \ 



Clusterization 



Remove 
Small Clusters 



polygon shape building module 



^ A 3D coordinate building module^ ^ ^ 
^ silh ouette mask writing module\ ^ 




pi a. Bl 



1 3D construction module I 

^ — f — — 



1 to I m 

I 
I 



initial 3D object building module 



m 

L. 

m 



refining module 





The mesh triangulation module 



1 



The texture map module 



rSdect a polygonal image object 
I Cf As the first silhouette image to procesi 



!3u 



fCreate a set of beginning and ending 
l^^^fVt- ^^^^^^ dost) polygons 



Order the vertices of each face following an 
t - I E g clockwise ordering. AJtA feoAA. ?<?ic£ 06»TfeCT5 

i*?4(.^ j_ 



"interconnect the far and near faces 
with additional faces (this creates 
A solid 3D object). 





p ^ refining 



module 



Loop to process each remaining silhouette image 



Get reference to the silhouette image obiect 

I 



Create a 2D projection of the 3D moael 
And project the silhouette polygon on to this plane 



Make a list of faces of all of the faces fi-om 
The model's 2D projection that intersect wkh 
The bounds of ttie silhouette polygon 



'For each interconnected face 
Generate a new set of coordinates on the 
X,Y plane to bound the area of overlap 



! 



1 



For the newly revised faces, 
Generate any new 3D X, Y,Z, coordinates 




To correspond to the new points 



I Neighbor adjustment procedure 




30^3 



J 





Loop to process each face references 










On the "overlap'list 
--^ ^ = 1— ^-^ 






Begin With a point of the silhouette image 
That lies within the bounds of the current face 



Add this data point to the revised list 
Of points for the face 



2cm 



Get the next point of the polygon silhouette being processed 
And begin a tour of its points moving in the direction of the view 
^Of the face in question. 



Determine w&ether there is an intersection 
Between the segment defined by the current point 
And the next point and any segment of the object 
That is not being toured (i,e. either the silhouette polygon 
Or the projected 2D image 




set the current point to be 
equal to the next point ' ^ ^ lOO 



get the next point &om the 
object that is currently being toured h 



Compute a 3D X.Y.Z, coordinate 
For that point of intersection 



Add this new point to the list of 
vertices for the face 




set me tour now ti be a tour of the 

"Other object" if you were touring 
The polygon silhouette now tour 



Set the end point of the segment intersected to 
be the new next point 

— — ~— c 



r 



Loop through each face referenced on the overlap list 

X 



r 



T 



get a reference to the next face ^^^ ^^ ^ [ 



i Firt J for W\S> '{^ce the tmt of the faces "old" 
neighbors. (The neighbors the face had 
before it was adjusted by silhouette overlap) 



Loop for each neighbor face reference 

— I ~ 



1 



5 



Ssremnns ft tlie neigfibor IS on' 
The list of revised faces 



Do nothing 

go to next neighbor 




Lai56 a,55 



KJo 



tieilTie vevised set of vertices 
For this neighbor 



Find the common edge that exists 
Between the two faces 



I 




FtdCTa reference to the 
Revised face in the corresponding 
Slot in the current face's neighbor list 



Add a refemce to this face on the 
Incomplete list 



Begin loop to process each fftcellid has 
Been referenced on the incomplete list 



[ ^ Get a reference to a face ' ^ 



Loop to go the facets neigkbor jS^ST 
process those slots that are null 




I yet a icierence to|a neighbor slot Y 
empty 




flo 



I Go to tne 2D projection and determme 
The origin of the face (i.e. whether it is 
Viewed internally or externally) 



Get the 2D coordinates of the points that 
make up the edge segment that 

corresponds to the empty edge — 
(e.g points A and B) 



Using one of those points (which should be a 
"drilled point") «g foirA A 

I 



Locate mat pomt in an ordered list of ''drilled points' 



Get the next point from the ordered list that 
corresponds to this point. i.e A* 



For that next point, find a face that contains both A I 
andB'from -l-W K^J *4 >^p\jLfe*:- ^i^<JLA^ 1 



t:onstruct a newike obifictfor the found face | ^ I 0 



Order the new points oflEe face to mamtaifllT 
clockwise ordering the face would be viewed from its 
external side. 



Load-the vertex and face data into the data object for 
the new face 




Update neighbor relationships for the new face 



Upd oi+e. net^V^i bof 



